DOCUMENT RESUME 



ED 237 597 



UD 023 204 



AUTHOR 
TITLE 



INSTITUTION 

PUB DATE 
NOTE 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



Opperman, Prudence; And Others 

The 1982-83 Promotional Gates Program! Mid-Year 
Assessment and Analysis of August, 1982 and January, 
1983 Test Results. Q.E.E. Evaluation Report. 
New York City Board of Education, Brooklyn, N.Y, 
Office of Educational Evaluation. 
Jul 83 
87p, 

Reports - Evaluative/Feasibility (142) 
MF01/PC04 Plus Postage. 

"Achievement Gains; Elementary Secondary Education; 
Grade 4; Grade 7; "Grade Repetition; Limited English 
Speaking; Mathematics Achievement; "Program 
Administration; "Program Effectiveness; Program 
Evaluation; Reading Achievement ,« "Remedial Programs - 
Resource Centers; "Staff Development- Summer 
Programs 

IDENTIFIERS New York (New York); "Promotional Gates Program 

ABSTRACT 

The Promotional Gates Program was initiated in the 
New York City Public Schools in order to set and maintain citywide 
curriculum and performance standards, identify students unable to 
meet the minimum standards, and provide remedial instruction. Under 
this program, the promotional policy sets "gates" at grades 4 and 7- 
students unable to meet performance standards at the end of these 
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A SUMMARY OF THE REPORT 



STUDENT ELIGIBILITY 

In April* 1982, 28,108 fourth* and seventh-grade students scored 
below the promotional criteria on standardized reading and/or mathematics 
tests and became eligible for the Promotional Gates Program- Of this 
number, 987 students were subsequently discharged from the school system 
and 2,029 students were granted exceptions from the promotional policy. 
By June, 1982, the number of Gates-eligible students was 25,068 — 18 
percent of all students enrolled in the fourth or seventh gra^** for the 
first time In 1981-82. 



SUMMER PROGRAM AND AUGUST TEST RESULTS 

Approximately 70 percent of Gates-eligible students registered for 
the Gates summer program. More than half of the students held over in 
June, 1982 took the optional retest in August, and more than a quarter 
of all the June holdovers attained scores which allowed promotion to the 
fifth or eighth grade before the outset of the 1982-83 school year. In 
general, students who took part in the Gates sumner program were more 
successful in meeting the promotional criteria in August than were 
students who had not participated or who had attended for only a few 
days* 

Students who had Initially scored below the criterion In one subject 
were more successful in gaining promotion than were students who had 
fallen below the criteria in both areas. Seventh-grade students made 
real gains in reading, but the reading achievement of fourth-grade hold- 
overs showed no real Improvement over the summer. Both grades made real 
gains in mathematics achievement. Summer school participants made 
greater strides than non-participants in both reading and mathematics. 

FULL-YEAR GATES PROGRAM: PLACEMENT AND ATTENDANCE DATA 

At the beginning of the 1982-83 school year, 19,051 students (13,7 
percent of all first-time fourth or seventh graders in 1981-82) were 
eligible for participation in the Gates program. Information collected 
on class placement Indicates that 87 percent of Gates Holdovers were 
placed in either Gates or Gates Extension classes by November, 1982. 
However, data gathered .through November 30 Indicate that, on the average, 
seventh-grade Gates students had poor attendance. Improving attendance 
remains a major challenge to program administrators* 



MIDYEAR OUTCOMES 



When Gates-eligible students were tested in January, 1983, 11 percent 
mrtnhe more difficult midyear criteria and became eligible for promotion. 
An additional 17 percent scored above the end-of -year promotional criteria 
In January, These results are similar to the midyear results of the 
1981*82 Mates program, The January test data also indicate that fourth- 
grade Gates students rode real gains of two months in reading and four 
months in mathematics, Seventh*gradi Gates students made gains of at 
least five months in reading and eight months in mathematics. Seventh- 
grade gains in reading were slightly higher this year than they were " 
last year; the performance of fourth graders was similar in the two years, 
As in the first year of the program, limited English proficient Gates 
students had lower achievement levels than other Gates students, indicating 
that services for this special group should be reexamined. 



GENERAL CONCLUSIONS 

The! Gates evaluation team noted some major strengths in the program's 
Implementation, 

I The organization and administration of the Gates program 

through January, 1983 was more efficient than it had 
been the .previous year, despite the introduction of 
the mathematics standard and the creation of three 
categories of Gates holdovers. 

Appeal procedures were formalized and more consistently 
applied than In the program's first year, 

Reactions to staff training for the summer and full-year 
programs were largely favorable, * 

At the same time, the team Identified areas requiring continued attention, 

Improving student attendance remains a major challenge 
to program administrators, 

A shortage of instructional materials related to suggested 
curricula hampered summer school instruction, 

5ervi.es to limited English proficient students should 
be scrutinized, judging by their performance on the CAT, 
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I. INTRODUCTION 

THE INTENT OF THE PROMOTIONAL POLICY 

Tne intent of the New York City Public School's promotional policy 
(Pronotlonal Policy for Students In Grades Kindergarten through Grade Nine, 
Chancellor's Regulation A-501) is to set and maintain city wide curriculum 
and performance standardi, identify students unable to meet the minimum 
standards, and provide remedial Instruction, The promotional policy sets 
"gates" at grades four and seven: fourth- and seventh-grade students unable 
to meet minimum performance standards at the end of the school year are 
retained rnd given Intensive instruction In reading and mathematics. 

The policy was Introduced in June, 1980. Promotional standards for 
kindergarten through grade nine were Implemented during 1980-81, and 
promotional gates in reading were established for grades four and seven 
at the end of the 1980-81 school year. At the end of the 1981-82 
school year,, promotion depended on performance levels in mathematics as 
wel 1 as reading.* 

THE PROMOTIONAL GATES PROGRAM. 1981-82 " 

A series of evaluation reports documents the Implementation process and 
assesses program outcomes during the first year of the Gates program.** 



staniarf 8 hnt^t ma < t 1 h r at1 " achiev f ent will no longer be used as a promotional 
standard, but it v1l I remain a performance standard. 

(O.EJ?™? 36 rep0r:s are available from the Office of Educational Evaluation 
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In Its final 1981-82 report, the Gates evaluation team concluded that the 
program met Its objectives with respect to staff selection and training, 
class size, scheduling requirements, and the use of exemplary curricula. 

In April, 1981, over 24,000 fourth- and seventh-grade students were 
identified as potential program participants based on their performance on 
one of two reading tests.* The number of participants changed during the 
course of the year as a result of exceptions granted and interim testing. 
By April, 1982, 69.5 percent of the 18,653 Gates students with complete 
test records had attained the promotional criteria. Those who did not 
were retained again In 1982-83 and placed in Gates Extension classes. 

Analysis of Gates students' April, 1981 pretest and April, 1982 posttest 
scores indicated that they made significant gains 1n reading, although 
their achievement did not differ greatly from that of a non-Gates eonparison 
group. The evaluation team concluded that while 70 percent of Gates students 
were better able to handle work In the next grade, helping the remaining 30 
percent of students meet promotional criteria continued to be a difficult 
problem. 

si 

SCOPE OF THIS EVALUAy ON 

In the present report, we have examined: 

staff development for 1982-83; 

" implementation of the Gates 1982 summer program and 
outcomes reflected in the August, 1982 test results; 

the Initial implementation of the 1982-83 Gates program 
and outcomes reflected in January, 1983 test results, 



* Tht Criterion Achievement Test (CAT) or the Criterion-Referenced 
English Syntax Test (CREST) . " ' — " - - 



*2- 



We asked the same basic questions about the summer and the full-year 
programs: to what extent did the program help students meet promotional 
criteria, and how much academic progress did the students make? To 
answer these questions we have looked at the achievement of various 
categories of Gates students in 1982-83: 
reading-only holdovers ; 
mathanatics-only holdovers; 
reading-mathematics holdovers, 
Th.'i data in this report refer to students held over in the fourth 
or seventh grade for the first time in 1981-82,* The report alio 
includes data on two subgroups of the Gates population: limited English 
proficient students and resource room students.** 

Throughout the report, we highlight program changes that occurred 
since last year. Chapter II, "Program Background," outlines the general 
operation of the Gates program: promotional criteria; the exception and 
appeals procedure; the testing schedule; and categories of eligibility, 
Chapter III, "Staff Development," briefly presents staff reactions to training 
for the summer and full-year programs. Chapter IV, "Summer Instructional 
Program," describes the summer curricula, discusses the evalation team's 



♦The Gates Extension Program, 1982-83, is evaluated In a separate Q.E.E, 

•♦Resource room students are mainstreamed special education student* 
receiving additional attention In resource classroom's (as opposed to " 
students In self-contained special education classrooms). 



-3- 



iz 



elassroan observations, and presents attendance data. We explore the 
Impact of the summer program in Chapter V, which presents the results 
of optional August retests. 

Although our end-of-year report will present a detailed analysis of 
the full-year Gates program. Chapter VI presents Initial data concerning 
class placements and student atte dance. Chapter VII analyzes the midyear 
test results and compares them to last year's midyear results. Chapter 
VIII presents our major findings d.'d conclusions, 
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II. PROGRAM BACKGROUND 

PROMOTIONAL CRITERIA, APRIL, 1982 
Reading Criteria 

As in 1981-82, fourth- and seventh-grade students had to take the 
California Achievement Test (CAT) and attain scores of at least 3,7 
and 6,2 respectively to be promoted, 

However, the promotional crit*» * for limited English proficient 
(LEP) students were changed In 1982, Students who had been in an 
English-language school system for more than two but less than four 
years were required to obtain a raw score above the twentieth percentile 
on the reading subtest of the Language Assessment Battery (LAB; English 
version).* For fourth-grade students, this was equivalent to a score 
of 13 (level II of the LAB) • for seventh-grade students this was equi- 
valent to a score of 25 (level III). Students in an English-language 
program for more than four years were subject to regular promotional 
criteria on the CAT, Students In an English-language program for less 
than two years were exempt from the promotional policy. 

Mathematics Criteria 

In April, 1982 students were for the first time subject to promo- 
tional criteria in mathematics. To be promoted, they had to attain 
scores on the New York City Matttematlcs Test (N.Y.C.M.T.) that were 



*In 1981, pronation of LEP students who had been 1n an English 
language school system for less than four years had been based on the 
Criterion Referenced English Syntax Test (CREST). 
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not more than two years below their grade level, (Fourth graders had 
to score 2,7 or above; seventh graders, 5,7 or above,) 

While the reading criteria for the two grades were roughly equivalent 
in ttnris of percentile ranks (twenty-seventh percentile for fourth grade 
and twenty-ninth percentile for seventh grade), this was not the case 
for mathematics. The fourth-grade mathematics criterion was equivalent 
to the seventh percentile in national norms while the seventh-grade 
mathematics criterion was equivalent to the twenty-third percentile, 
One would therefore expect to see significantly fewer mathematics hold- 
overs in fourth grade; this was Indeed the case, 

STUDENT ELIGIBILITY 

The promotional policy allows students to move into and out of the 
Gates program at a number of points In the school year, The Gates 
population changes as students attain promotional criteria at any one 
of a number of test administrations, are granted waivers of the promotional 
standard through exceptions or appeals or are discharged from the school system.* 

Promotion at the end of the 1981-82 year depended on the April , 1982 
tests. Optional retests were administered in August, 1982, During the 
fall s the tests were given to students who had not been tested in April 
or August, Students were retested in January* 1983, for midyear promotion; 
midyear promotion criteria, however, were more stringent than end-of- 
year criteria. 



*A detailed accounting of pupil movement In and out of the Gates 
program is presented in Appendix A, 
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Figure 1 presents the number of students In the Gates program at 
various points from April, 1982 through February, 1983* In April, 1982, 
28,108 students, or 21,6 percent of all students in the fourth or 
seventh grade for the first time, failed to meet promotional criteria. 
The Office of Promotional Policy granted exceptions to 2,053 of these 
students, and thus in June, 1982, 25,068 students, or 18 percent of 
first-time fourth and seventh graders, were actually held over* A 
breakdown of the June holdovers by grade and eligibility category Is 
presented in Table 1. The number of seventh-grade holdovers was 
more than double the number of fourth-grade holdovers, an Imbalance 
reflecting the relatively greater impact of the mathematics standard 
on the seventh grade* 10 percent of fourth-grade and 72 percent of 
seventh-grade holdovers did not meet the mathematics criterion. 

EXCEPTION AND APPEALS PROCEDURE 

In 1982-83, procedures for requesting exceptions from the promotional 
policy were formalized by the Office of Promotional Policy (O.P.P.) and 
In Hay, 1982, these procedures were announced in a memorandum to community 
superintendents* Principals requesting Individual exceptions were required 
to submit a detailed educational profile for each student on a standard 
form, As in the previous year, principals * requests were sent to the 
canmunity superintendent; approved requests were then forwarded to the 
Office of Promotional Policy for consideration, In addition, this year 
all parents of fourth- and seventh-grade children who did not meet 
promotional criteria were advised by letter of the Chancellor's 
regulation authorizing their right to appeal the promotional status of 
their children* 
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TABLE 1 



Categories of Student Eligibility for 
the Promotional Gates Program 
as of June, 1982 



Reading-on^y 
hoi dovers 



Mathematlcs-gnly Readl ng-Mathema|1cs 



hoi dovers hoi dovers 



Total 
hoi dovers 



Grade 4 
Grade 7 



7 S Q59 
4,683 
11,742 




7,886 
1 7.182 



i 0T£ - : The promoti una] status of an additional 4,842 students was unknown 
because they lacked scores for both tests or they lacked either a reading 
lathenatics score but met the criterion in the other subject* 

l Holdovers In only one subject either scored above the criterion, or were 
missing scores in the other category, 

Reading-mathematics holdovers scored below the criterion in both subjects 
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Exceptions were generally decided by considering the number of months 
a student's total score fell below the promotional criterion; a student's 
comprehension subtest score on the CAT; and/or a student's problem-solving 
subtest score on the N.Y.C.M.T. For the first time, the Office of 
Promotional Policy also considered indications of ability on alter- 
native test? of reading: the Degrees of Reading Power (D.R.P.) and 
the Pupil Evaluation Program (PEP) tests. 

In examining exceptions for seventh-grade students, reviewers also took 
into account the number of subjects a student had failed. The exception 
was more likely to be denied if a student had failed several subjects. 

The number of exceptions granted in 1982 was five times the number 
granted in 1981, reflecting the Impact of the new procedures. 
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III. STAFF DEVELOPMENT 

EVALUATION QUESTIONS 

An important component of the Promotional Gates Program is the 
training of program staff. In 1982-83, training for district facilitators, 
supervisors, and teachers was held on three separate occasions. Training 
In June anticipated the Gates summer-school program. Training for the 
full-year program took place over a two-week period in August and on one 
additional day in November. 

We looked at summer school pre-service training and at pre- and in- 
service training for the full-year program with the following questions 
i n mi nd : 

What changes had occurred in the organization and im- 
plementation of the training programs since the previous 
year? 

What were participants' reaction to the programs? 

Were there differences in the perceptions of ■facilitators 
supervisors, and teachers? between teachers of different 
subjects? 

TRAINING FOR THE SUMMER PROGRAM 

To prepare for the summer program, leaders of district staff develop- 
ment received three hours of training in their subject area - conmuni cation 
arts or mathematics; site supervisors received three hours of training 
related to both subjects; and teachers received four hours of pre-service 
training In the appropriate subject(s). Teachers were also required to 
attend a total of eight hours of in-service staff development during 



afternoons In July and August, after teaching students in the morning. 
This additional training was conducted In the districts, not centrally. 

In general, supervisors and teachers surveyed by the evaluation team 
seemed pleased with the summer workshops. Many did suggest, however, 
that training was rushed and that more time at workshops for reviewing 
materials and practicing new techniques might be helpful. For the most 
part supervisors and teachers expressed similar reactions, although 
supervisors as a group felt less prepared to handle the responsibilities 
of the program (66 percent of the supervisors felt prepared, compared 
with 80 percent of the teachers). 

Table 2 provides a breakdown of positive ratings given to the 
workshops by teachers In each grade and subject area. The percentage of 
positive ratings of communication arts workshops ranged from 48 percent 
to 92 percent. Mathematics workshops consistently received higher rating 
the percentage of positive ratings ranging from 68 to 95 percent among 
fourth-grade teachers, and from 60 to 94 percent among seventh-grade 
teachers, 

TRAINING FOR THE FULL-YEAR PROGRAM 

Pre-Servlce Training — August, 1982 

The Division of Curriculum and Instruction conducted a needs assess- 
ment among Gates staff which was used to plan training for the full-year 
Gates program. Ten half-day sessions were held from August 16 to August 
27. New Gates teachers received more extensive training (20 to 40 hours) 
than teachers participating in the program for a second year (8 to 16 
hours). 



TABLE 2 

Teachers 1 Reactions to Training for the Summer Program 



Percentage of Positive Ratings 



Communication Arts Mathematics 
Grade 4 Grade 7 Grade 4 Grade "T 
Quest1ons (N-116) (N=155) (N«22) (N-119) 



The Gates programs were 

clearly explained, Q7% 83% 95% 9255 

Questions were answered 

satisfactorily, 92 81 91 94 

Relevant demonstrations/ 

examples were provided. 76 71 91 31 

Relevant activities/ 

exercises were provided, 77 66 82 76 

Had opportunity to prac- 
tice techniques. 48 51 68 60 

Appropriate balance of 

explanation and practice 57 56 77 in 

was provided. 

Had opportunity to study 

program materials. 61 69 77 77 

Now understand the 

Gates stmimer program. 77 74 gg 33 

Bel leve the Gates 
summer program will 

be effective. 76 70 86 83 

Teachers 1 needs 

were addressed. 72 65 82 84 

Feel prepared for 

responsibilities. 81 81 86 93 



Twenty of the 25 facilitators who attended training In August 
responded to an evaluation questionnaire, and their reactions were 
generally favorable. Eighty percent felt that questions were encouraged 
and answered professionally; 70 percent felt that relevant activities 
were provided. Most facilitators also expressed confidence in their 
overall ability to implement the Gates program in 1982-83 (84 percent) 
and to deal with situations that they were likely to encounter (80 
percent). 

A smaller majority of facilitators felt that the training prepared 
them for specific responsibilities, such as evaluating program effect- 
iveness (65 percent), organizing follow-up staff training (60 percent), 
and understanding the relationship of special and bilingual, education to 
the, Gates program (60 percent). 

Supervisors and teachers were also asked to evaluate their training. 
Table 3 presents results from 116 supervisors and 1,293 teachers who 
responded to our questionnaire; most of them gave positive ratings to 
each aspect of training reviewed. Most felt that questions were en- 
couraged and answered professionally, that relevant activities were 
provided, and that they were prepared to supervise or teach the Gates 
program. However, fewer respondents In both groups felt that they had 
had sufficient time to learn program techniques. 

.In-Service Training -- November, 1982 

In-service training during 1982-83 was also reorganized to reflect 
the program staff's experiences in 1981-82. In 1981-82, each district 
had held its own teacher training, offering eight hours of training in 
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communication arts and eight in mathematics. This year, staff training 
planned and administered central ly and offered to both teachers and supe 
In the form of a six-hour session held on Veterans Day. Districts using 
exemplary programs provided an additional four hours of local training. 
Only districts using optional programs provided all 16 hours of staff 
training locally. 

Most of the workshops given at the training sessions were led by 
experienced Gates teachers or curriculum specialists. They covered a 
wide variety of topics, such as oral -language development, mathematics 
anxiety, the use of audio-visual media, techniques for teaching writing 
in Gates classrooms t and exemplary curricula. 

Overall, participants rated workshops favorably: 92 percent found 
that the workshops helped them Improve classroom instruction; 89 percent 
planned to use materials from the workshops in their Instructional 
programs and 81 percent felt that follow-up workshops should be provided. 
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TABLE 3 

Reactions of Supervisors and Teachers to Pre-Servlce 
Training for the Full-Year Gates Program, August, 1982 



Percentage of Positive Ratings 

n , toct1 - nc Supervisors Teachers 

Questions n»116 N-1,293 



stlons were encouraged and 
answered professionally, ggj 

Rel evant demonstrations/activities/ 

exercises wire provided, 35 

Had opportunity to study program 

materials, 79 

Had sufficient time to learn 

progrOT techniques, 57 

Learned how Gates teachers are 

to use individual diagnosis to plan 

for instruction, 75 

Participant's needs were addressed, 73 

Understand this Gates program, 35 

Agree with instructional methods 
to be used, 



Believe this program will be 

effective, 34 

Feel prepared to supervise/teach 

this Gates program, 33 



88% 
S3 
69 
60 

71 
73 
77 



84 70 
79 



75 



^Supervisors and teachers were generally satisfied with pre-serviee 
training for the full-year program, 

'Both groups were least satisfied with opportunities to practice 
techniques. 



w. summe: r instructional program 

The summer instructional pr ogram was conducted for six weeks, 
from July 6, 1982 to August 13, 1982. A minimum of five teachers and 
100 students was required to es ^o,ish a site. There were 133 summer 
school sites in the ^districts, each supervised by a summer admin 1s- 
trator. Students in both grades received one and one-half hours of com- 
munication arts and/cione and one-half hours of mathematics Instruction 
daily, 1n classes of minora than 20 students, 

DESCRIPTION OF CURRICULA 

The curriculum guide for the summer Gates reading Glasses (both 
grades) suggested that each dail y lesson include a few minutes of journal 
writing and newspaper reading , a whole-group reading lesson basid on 
literature or content-area materials, a period of skills instruction, sus- 
tained silent reading', me oral reading by the teacher, and a preview of 
the next day's lesson. The guides also provided teachers with reading assessment 
materials and sample lessons. = 

The mathematics guide suggested that the daily lesson include homework 
review, problem-solving, a dl rect=ed group lesson, smal 1 -group Instruction/ 
individualized skill practice, hcsmework assignments, and a summary-preview. 
It also prescribed objectives aneS provided a planning log, a large selection 
of instructional activities, and appropriate mastery tests. 
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CLASSROOM OBSERVATIONS 

The evaluation team visited 66 Gates c1astfesii44 summer school sites.* 
Observers considered three aspects of instruction: envt ronment; classroom 
climate; and lesson organization and content. Thiy ratesKi classrooms by 
assigning either a positive ("adequate" or "cotiftieAbl e" ) , a negative ("needs 
attention"), or non-evaluative ("not appl 1 cable" ) rating ,** 

Table 4 shows the percentage of comrnun ieationirfs a nd mathematics 
classes receiving positive ratings. Since Gates (lasses in both fourth 
and seventh grades followed the same instructional plan for each subject, 
and since observations led to similar findings fafkoth Mradis, ratings 
for fourth- and seventh-grade classes are combined. 



♦Twenty-four observers visited 21 fourth grades and ffi&5 seventh grades 
in all dTstncts, covering five to eight percent of classes in each of four 
instructional categories: fourth-grade commun icatlon art=s, fourth-grade 
mathenatics, seventh-grade communication arts, and wen1=h-grade mathenatics, 

**To obtain a measure of interrater reliability two ©observers visited 
the same 18 classrooms. Each observer rated the classrocsssns separately and 
uhey later compared ratings. Where ratings diffferi, thegry resolved the 
differences after discussing the observed lesson a'.: the basis for assigning 
a rating. In this way, each of 18 classroom's was «s1gne~^d a pair of ratings 
along 14 relevant criteria. Of the 252 pairs of ratings - thus assigned 86 
(^4 percent) were originally in dl sagreenent. Of tiise, 38 were resolved 
in favor of the higher score, 32 were resolved in 'nor o f the lower score 
and six were resolved in favor of a rating midway Mwten the two original' 
ratings. In ten cases, one observer shifted from anoneva-al uative rating 
("not applicable") to the rating assigned by the -other obsserver. 
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TABLE 4 

Observers 1 Ratings of Summer Classes 



Percentage of Posit Ive Ratings 



Communication Arts Mathematics 
Grade 4 & Grade ? Grade tl Grade 7 

Questions N= 36 fj- 30 



Area 

School Envi ronment 



Security maintained 78% 80{ 

School Climate 83 fin 



Classroom Climate 

Physical conditions 58 
Room arrangement 78 
Sufficiency of mater-lals 53 
Noise level 94 
Pupi 1 -teacher, pupil- 

pupil interactions 92 

L esson 

Reflects suggested 

curriculum 44 
Content appropriate %o 

student needs 83 
Objective clearly presented 78 
Pupils able to practice 53 



83 
77 
70 
87 

93 

53 

83 
83 
77 



Teacher gives guidance 92 83 

Orderly and product! ve pace 69 7? 
Lesson summarized, preview 

given, homework assigned 28 70 



°School environment and classroom climate generally received high ratings, although the percentages 
of positive ratings assigned to communication arts classes In re gard to physical conditions and mat. 
were relatively 1 ow, 

^Observers assigned fewer positive ratings to communication arts Wesson! than to mathematics lessons 
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The program was satisfactorily implemented in a majority of the classes 
visited, Aspects of school envlronnent school security and school 
climate — were rated positively for at least three-quarters of the classes. 
For the most part, observers also praised the classroom climate, at least 
those elements which were within the teachers 1 control such as noise level, 
room arrangement, and classroom interactions. They were less enthusiastic 
about the physical condition of the rooms and about the sufficiency of 
materials, particularly in the communication arts classes, 

In general , observers were more critical of communication arts lessons 
than of mathematics lessons, noting that pupils were given less opportunity 
to practice and that teachers failed to summarize or preview lessons, or 
assign homework: only 28 percent of the communication arts classes received 
positive ratings in these areas. 

Although observers indicated that content In most classes was appropriate 
to student needs, many of the lessons did not clearly reflect the suggested 
Gates curriculum objectives or procedures: only 44 percent of the ccmmunlcatio 
arts classes and 53 percent of the mathematics classes received positive 
ratings in this regard, 

ATTENDANCE 

Throughout the summer program, districts provided the Office of 
Promotional Policy with Information on the dally attendance of students 
at district summer sites. Table 5 provides a ci tywide summary of this 
Information, District registers indicate a total of 13,624 students — 
71 percent of those eligible — registered for , eading classes and 8,951 
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TABLE 5 



Average Daily Attendance in Summer Program 
Reading and Mathefnatles Classes 







Eligible 


Registered 
(% of eligibles) 


Average Daily 
Attendance 


Percentage in 

Attendance 
(S of regiitered; 


Readi ng 




N 


% 


N 


% 


Grade 4 
Grade 7 
Both grades 


7,709 
11,355 
Id, 064 


5,600 
8,024 
11,62? 


72.6 
70.7 
TTTf 


4,431 
5,731 
10,162 


79.1 
71,4 
74TB" 


Mathematics 












Grade 4 
Grade 7 
Both grades 




469 
8,482 
8,951 


56.7 
67,9 
"8771 


405 
5,723 
6,128 


86.4 
67,5 
6175" 
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students -- 67 percent of those eligible - registered for summer mathematics 
classes. 

Data for Individual students in each district Indicated that 46 percent 
of the reading students and 44 percent of the mathematics students eligible 
for the summer program attended at least half of the total Instructional 
sessions.* 

Of those who registered for summer school, the average daily attendance 
of fourth-grade students w as better than that of seventh-grada students. (Th 
percentage of fourth graders enrolled In the matha.-tics classes, however, 
was relatively 1 ow.) 



^Appendix B presents summer attendance date for individual districts. 



V, OUTCOMES : AUGUST, 1982 TEST RESULTS 

EVALUATION QUESTIONS 

The optional August test gave students a second opportunity to attain 
the promotional criteria and become eligible for promotion to the fifth or 
eighth grade* Our Initial questions in looking at the August, 1982 test 
data were: 

— What proportion of Gates students became eligible 
for promotion to the fifth or eighth grade in 
August, 1982? 

What w&re the gains of Gates students in reading 

and mathematics from April to August, 1982? * 

Since we were particularly interested in the impact of the voluntary 

summer program, we conducted a separate analysis to compare the test results 

of participants with nonparticipants, ana asked: 

" What was the impact of summer school participation 
on criteria attalrtnent and on achievement in 
reading and mathanatics? 

Thus the first section of the chapter provides an overview of August, 1982 
test results; the second section looks more closely at the effect of 
participation In the summer program* 

AN OVERVIEW 
Criteria Attainment 

Table 6 provides an overview of the students who attained the promo- 
tional criteria in August, More than half of the students eligible for 
the Gates program — an almost equal proportion In each grade — took 
the optional August test. The 6,734 students promoted on the basis of 
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this testing represent 26,9 percent of the June holdovers.* The proportion 
of students promoted was nearly the same in both grades (25.8 percent and 
27,3 percent In the fourth and seventh grades, respectively). 

The number of students in each category of ellblllty is also illus- 
trated In Table 6. As might be expected. In each grade the proportion 
of reading-mathanatics holdovers attaining criteria was much smaller than 
the proportion of successful reading-only or mathanatlcs-only holdovers; 
in the fourth grade, only 5.8 percent of the readi ng-mathanatics hold- 
overs met the criteria. 

Student Achievement 

To measure student achievement, we examined test results for all 
students with scores from both April and August tests.** We adjusted 
the average April scores in each grade to account for regression to 
the mean*** and to permit an estimate of gain over and above effects 
due to regression. 



*The number of students promoted represents 45 percent of the retested 
group. 



The summer tests were voluntary, and students who chose to retake 
the test in August were those who might have been expected to score higher 
than the average Gates holdover. Therefore conclusions about the two 
groups must be drawn cautiously, Appendix C displays differences In the 
scores of the two groups. 



***The regression effect has been discussed in previous evaluatl 



reports on the Gates program. It results when the same test 1s used for 
both pupil selection and program evaluation and Is particularly strong 
at the "tails" of a test score distribution. Appendix D presents the 
adjustment procedures followed here. 
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TABLE 6 



Criteria Attainment by Eligibility Category 
August, 1982 



Grade 4 



Tota1 Reading-Only Mathematics -Only Reading -Hat hematics 

(% of eligibles) (% of eligibles) (% of eligibles) 

Number tested 4,686 (by, AX) 4,402 (62,4%) 75 (42,4%) 209 a (32. 2%) 

June holdovers 7,886 7,059 177 650 

Met criteria fa 2,038 1,947(27,6) 58(32,8) 33 (5 8) 

Category shifts 0 *_ 55 + 163 +33 _14! 1 } 

September holdovers 5,*T03" 5,275 T52 476 



Grade 7 

Number tested 10,566 (61.5%) 3,165 (67.6%) 3,819 (65.5%) 3, 582* (53.7%) 

June holdovers 17,182 4,683 5,827 6 672 

Met criteria 4,696 1,961 (41,9) 2,143 (36,8) *592 fa 8) 

Category shifts 0 - 183 + 537 +1,016 ' 

September holdovers 12, 669 3,259 A\ 700 



1,370 
4,710 



Nuu; Numbers in parentheses indicate percentage ot total June Ga tes-eligible students when applica ble. 
This does not Include students tested in only one of the two subjects, 

'Category shifts arose primarily from: reading-mathematics holdovers who met the criterion on onlv 
one summer test, and students not previously tested who failed to meeUcMterla on one or both tests. 

"The percentage of students attaining the joint reading-mathematics criteria 
was small in both grades. 
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Reading Achievement. Table 7 summarizes April and August, 1982 CAT 
results for all retested June holdovers with below-eriteri on April reading 
scores, This Includes reading-mathematics holdovers as well as reading, 
only holdovers, (No analysis of bilingual students' LAB scores was 
possible since few students had been held over on the basis of their 
LAB scores,) 

On the average, fourth-grade students showed an adjusted gain of only 
two scale-score units from April to August testings. Their observed gain 
was no greater than would have been expected as a result of regression. 
On the other hand, seventh-grade students' April to August adjusted gains 
indicated a real gain for this group. Their adjusted gain of 12.1 scale- 
score units is equivalent to a gain of at least four months. 

Ma thematics Achievement , Table 8 summarizes the April and August, 
1982 N.Y.C.M.T. results of all retested June holdovers who had initially 
scored below the mathematics criteria. On the average, fourth-grade 
students obtained an August score which was, in grade-equivalent terms, 
three months higher than their adjusted April score, The average 
August grade equivalent of students In the seventh grade was four months 
higher than their adjusted April score,* Scores in both grades indicate 
significant mathematics achievement during the summer months. 



'Grade-equivalent scores should not be used to compare achievement 

aL^vi^ 9 " deS ' S" 16 " 0 ^ 5 ^ ^e appropriate metric for comparing 
achievement across grade levels. Table 8 indicates that fourth graders 
made higher scale score gains than seventh graders. 
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TABLE 7 

Summer Reading Achievement 
by Gates Students 



April, 1982 August, 1982 



Di f f erenC" 



Observed mean Adjusted mean Grade Scale Grade qralp 

Grade N a scale score (S.D, ) scale score 8 equivalent score (S.D.) eqSlSlent fcore 



Four 4,549 375.1 (21.6) 390,5 3.5 392,5 (30.0) 3.5 2.0 

Seven 6.862 454.2 (26.6) 470.1 5.6 482.2 (38.3) 6.0 12.1 



This analysis includes students who had both April and August, 1982 CAT scale scores Too few 
students had April and August, 1982 LAB scores to analyze achievement on that test, 
b. . . 

An adjustment was made to account for regression to the mean, 

"Fourth-grade students showed no greater gain than would have been expected as a 
result of regression. , - 

"Seventh -grade students showed an average adjusted gain of four months. 
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TABLE 8 



Summer Mathematics Achievement 
by Gates Students 



A P ri1 * 1382 August, 1982 



Di f ference 



Mean 



> j a Observed mean Adjusted mean Grade scale Rrarip 

•rade H scale scone (S.D.) scale score 8 equivalent score (S.O. ) anient score 



our 



277 246,8 (9,8) 254,7 2.6 273.9 (24,1) 2,9 19,2 

even 7 S 037 344.6 (18,9) 351.8 5.0 362.6 (30,0) 5,4 10.8 



This analysis Includes students who had both April and August, 1982 N.Y,C.M,T. scale scores, 
An adjustment was made to account for regression to the mean, 

e Both grades made significant gains in mathematics. 

e Fourth graders showed average adjusted gains of three months 
or 19,2 scale score units, * 

°Seventh graders showed average adjusted gains of four months 
or 10,8 scale score units. 
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IMPACT OF SUMMER SCHOOL PARTICIPATION 

The six-week summer program consisted of 28 days of instruction In 
reading and 27 days in mathematics. In order to examine the impact of 
program participation, we defined students who attended for 15 or more 
instructional days as participants; we defined those in attendance for 
fewer (or no) days as nonparticipants, (The number of students in 
attendance for at least one but less than 15 days was small,) 

In comparing scores of participants and nonpartleipants, It is impor- 
tant to bear in mind that the proportion of participants taking the tests 
was much greater than the proportion of nonpartleipants taking the test,* 
In addition, participants were probably more highly motivated, and thus 
more likely to score well, On the other hand, within the retested group, 
participants and nonpartleipants had similar April scores,** It may also 
be true that some of the nonpartleipants taking the August test had re- 
ceived tutorial or other assistance, 

The Surmner Reading Program 

Table 9 separates the reading holdovers into two groups: those who 
participated in the summer program 15 or more days and those who did not. 
Approximately half or (46,5 percent) of the 19,064 students held over for 
reading attended summer school for IS or more days, Proportions were similar 
in the two grades, 



*Among the participants, 98,5 percent (or 8,727 students) took the 
reading test, compared with only 29,9 percent of the nonpartleipants (or 
3,048 students). In mathematics , the figures were 98,8 and 31,4 percent 



TABLE 9 



Attainment of Reading Criteria by 
Summer School Participants and Nonpartlci pants 



Grade Four (N a « 7,709) 



Grade Seven (N a = 11,355) 



Participants Nonparticipants Participants Nonparticipants 
(15+ days) ( 15+ days) 





n 


(%) b n 


(%) b 


n (%) b 


n 


(%) b 


Retested: 














Met criterion 
Did not meet 


1,676 


(44.8%) a 346 


(37.Q%) a 


2,642 (53,0%) a 


882 


(41,8%) 


criterion 


2,068 
3 , 744" 


(55,2) 590 

936 


(63.0) 


2,341 (47,0) 
4,983 


1,230 
2,112 


(58.2) 


Not retested 


82 
3,826 


2,947 
3.883" 




55 
5,038 


4,205 
6,317 





frfakJlt S ?hfi r AR 8S %rH e ; th(!r ' hG CAT ° r * 1f the student was eligible 
to take it, the LAB, Students without a test score by August 1982 were 

SuL^hnn! <J ^V C in A T S |* 19 S Z and are not 1nclud « d in these numb^l. 
arr? ,^?nL P hInI CipantS f0 :- wh0rn no attendance information was entered 
I^S-IiS- ? ? re 35 nonparticipants, LAB-eligibles were classified 
as nonparticipants since attendance data were not available for them.) 

"N" represents the number eligible in each grade (7,709 in grade four 
and 11,355 in grade seven); "n" represents the number In each attendance 
category. Percentages of students who met or did not meet criteria in 
each attendance category are based on the number tested: 4,680 fourth 
graders and 7 095 seventh graders. Comparisons of the attainment rates 
of participants and nonparticipants (using a Chi square test) showed: 

|f3) = 74.*76! °p<?000?: — =1) " 18 " 2, £< - 0001; 9rade seven » ("erected, 
Percentage of those retested. 
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Criteria Attainment. In each grade, summer school participants were 
more likely than the nonpartici pants to meet the reading criteria. (See 
Table 9.) In the fourth grade, 44,8 percent of the participants met the 
criterion, compared with 37.0 percent of the nonpartici pants. The dif- 
ference was larger in the seventh grade: 53 percent of participants met 

the reading criterion, compared with 41.8 percent of nonparticipants. 

These wlthln-grade differences were statistically significant. These 

data are di splayed graphical ly in Figure 2, 





Student Achievement Gains , Table 10 summarizes data concerning pretest 
and posttest scores of participants and nonparticipants. In each grade, 
summer school participants made significantly greater gains from April 
to August than did nonparticipants* In the fourth grade, the average score 
of participants was one month (five scale score units) higher than that 
of nonparticipants, and in the seventh grade, the average score of par- 
ticipants was four months (nine scale score units) higher than that of 
nonparticipants. 

The Suroier Mathematics Program 

Table 11 displays the number and percentages of mathematics holdovers 
attaining criteria on the August, 1982 N.Y.CM.T, A relatively small 
percentage of fourth-grade mathematics holdovers attended summer school.* 
Only 26,5 percent of the 327 eligible fourth graders participated in 
the summer mathematics program, conpared with 47,5 percent of eligible 
seventh graders. 



*This may in part reflect differences in eligibility. In the fourth 
grade the number of mathematics-only holdovers was relatively small; 
thus'mathematlcs holdovers were primarily reading-mathematics holdovers 
In the seventh grade, there were a large number of mathematics-only 
holdovers as well as a large number of reading-mathematics holdovers- 



TABLE 10 



Comparison of Reading Achievement: 
Summer School Participants and Nonparticipants 







Observed mean 
scale score 
August, 1982 


(S.D,) 


Adjusted mean 
scale score . 
August, 1982 


Grade 
equivalent 




Grade Four Participants 


3,746 


393,5 


(29.8) 


393.4 


3.5 


20,5 


Nonparticipants 


803 


387,8 


(29.3) 


388.3 


3.4 




Grade Seven Participants 


4,988 


485.4 


(38.0) 


485.4 


6.1 


139.0 


Nonparticipants 


1,874 


474.0 


(38,0) 


474.0 


5.7 





This analysis includes Gates-ell gi ble students who had both April and August 1982 CAT 
scale scores. ' 

b An analysis of covariance (ANC0VA) was performed to adjust the August, 1982 scores- this 

oartic Un^^AnMi^nf 5 f ° r d1fferences bet ween summer school participants' and non- 
participants April* 1982 scores, 

*£C0001 in both analyses, 

^Average gains of fourth-grade participants were one month higher 
than those of nonparticipants, 

"Average gains of seventh-grade participants were four months higher 
than those of nonparticipants. 
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TABLE 11 



Attainment of the Mathematics Criteria by 
Summer School Participants and Non participants 



Grade Four (N a = 827) Grade Seven (N a = 12,499) 



Participants Nonparticlpants Participants Nonparticlpants 
15 + da ^s ______ 15+ days 



« 3 (%) b n 8 (%) b n a (%) b n a (%) b 



^inot'meet (74 * 3) 56 (64 * 4) 2 ' 6 ' 5 ^ 67 3 

criteria 54 (25.7) 31 (35.6) ^gp (49.1) 1,619 (70.6) 

Not retested 9 531 gg 



|0TE. These figures only include students with at least one below-cri teri on test 
score in June. Untested students would not have been identified as for 

^ hJ 09 ™', A1 ? 0 ' SUm ? er Sch001 Participants for whom no attendance 
information was entered are classified here as nonparticlpants. 



i'n" e ^h r !^ nt S the numbor ell '9TbU in each gride; "n" represents the number 
in each attendance category, 

b 

Percentages of students who met or did not meet criteria In each attendance 

^iT«9 are 0n ., the number wh0 act "aHy took the test: 297 fourth graders 

and 7,552 seventh graders. Comparisons of the attainment rates of participants 
and nonparticlpants showed- grade four, chi square (corrected df-1) = 2 50 
P=.ll; grade seven, chi square (corrected, df=l) - 297,9, p<,000T7 ' ' 
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Criteria Attainment, In each grade, a higher proportion of participants 
than nonparticipants met the mathematics criterion, although the cHff,. ^ „ 
was statistically significant only in the seventh grade. In the ^urth 
grade, 74.3 percent of the participants who took the mathmaties ^st 
met the criterion, canpared with 64,4 percent of the nonparticipants. 
In the seventh grade, 50.9 percent of those who attended summer classes 
met the criterion, compared with 29.4 percent of the nonparticipants. 
Figure 3 displays these data graphically. 
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Achievement, Table 12 compares the mathematics gains of summer 
school participants and nonpartlcipants from April to August, The gains 
of summer school participants were significantly greater than those of 
nonpartlcipants in each grade. In the fourth grade, the average August 
score of participants was two months (seven scale score units) greater 
than that of the nonpartlcipants. The difference between participants 
and nonpartlcipants was greater In the seventh grade: the average August 
score of participants was six months (14 scale score units) greater than 
that of nonpartlcipants. 
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TABLE 12 

Comparison of Summer Mathematics Achievement 
by Summer School Participants and Nonparticipants 



Grade 



»r 

school 



Observed mean Adjusted mean 

scale score scale score . 

August, 1982 (S.D.) August, 1982° 



Four Participants 203 276,0 

Nonparticipants 74 268*1 



mi] 



275,7 
268,9 



Grade 
equivalent 



3,0 
2.8 



Seven Participants 5,065 
Nonparticipants 1,972 



367.0 
351.3 



(29.6) 
(27.9) 



366.5 
352.7 



5.6 
5.0 



"511 tz&^^r scoS: ell91ble students who had both apmi and 

b Sn™ ly Jl? ° f c ? va C 1a " ce (ANCOVA) was performed to adjust the August, 1982 
scores; this partial adjustment accounts for some of the difference between 
summer school participants' and nonparticipants' April 1982 scores 



C F=29.1, £<.0001 
d £=499.Q, p<.0001 



'Average gains of fourth-grade participants were two months (seven 
scale score units) greater than -hose of nonparticipants. 

'Average gains of seventh-grade participants were six months (14 
scale score units) greater those of nonparticipants. 
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VI. THE FULL-YEAR GATES PROGRAM: CLASS PLACEMENTS AND ATTENDANCE 

Following the August testing, 18,572 students were eligible for 
participation in the Gates program, In September, make-up tests adminis- 
tered to students with missing test scores resulted in the identification 
of an additional 479 Gates-eligible students, bringing the Gates popula- 
tion to 19,051 students, Updates of the data base by the Office of Student 
Information Services (OSIS) indicate that another 155 students were 
Identified as eligible during the fall, bringing the total Gates population 
to 19,206.* 

CLASS PLACEMENTS 

Table 13 displays the classroom rlacanents of Gates students reported 
by districts on the November 30, 1982 roster. Information was available 
for 93.1 percent of the students (17,880 students). Of these, 85.1 
percent were placed In Gates classrooms and an additional 2.1 percent 
assigned to Extension classes.** The renal nlng 12.8 percent were, for 
the most part, held over but not put into Gates classes: either none 
were available in the school and parents refused cluster site assignments, 
or the students were promoted to the next higher grade despite the promo- 
tional policy. 



*See Appendix A for a more detailed description of the make-up 
testing and updates of the data base, 

"Because there is some ambiguity on the data base regarding the 
definition of an Extension student, it Is likely that some of the 373 
students had been incorrectly identified as Gates students and actually 
belonged in these Extension classes, ' 



TABLE 13 

Class Placements of 1982-83 Gates Students 



Class Placenent 





Gates 


Gates 
Extension 


Non-Gates Unknown 


l Tntal 


four: 












Readi ng-only 


4 t 096 


106 


758 


486 


5,446 


Math-only 


73 


i 


61 


20 


155 


Readi ng-Mathmatles 


414 


16 


46 


52 


528 


Total 


4 S 583 


123 


865 


558 


6,129 


Seven: 












Readi ng-only 


2 S 61S 


97 


380 


222 


3,317 


Mathematics -only 


3,711 


23 


731 


319 


4,784 


Readi ng-Mathenatics 


4,304 


130 


315 


227 


4,976 


Total 10,633 


250 


1,426 


768 


13,077 


5 85 e l percent of students for 
in Gates classes, 


whom data 


were available 


were 


pi aeed 



'Placement of fourth-grade mathematics-only holdovers was 
inconsistent- only 54,1 percent were placed In Gates classes, 
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Placement of fourth-grade students held over solely for mathematics 
was inconsistent because in many schools the number of students In this 
category was too small to constitute separate classes: only 54, i percent 
of the 135 fourth-grade mathematics-only holdovers were assigned to Gates 
classes. 

Attendance 

The Office of Student Information Services collected and analyzed 
attendance data on Gates students through November 30, 1982. These data, 
displayed In Table 14, Indicate that attendance by seventh-grade Gates 
students was poor. While 62.1 percent of fourth-grade Gates students 
attended school mora than 94 percent of the time, only 43.4 percent of 
the seventh graders did so. Almost 30 percent of seventh-grade holdovers 
attended school less than 83 percent of the time. The evaluation team 
will provide more complete information on the full-year attendance pattern 
of Gates students in an end-of-year report, but this Initial sampling 
strongly suggests that efforts to improve the attendance of Gates 
students must continue. 
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TABLE 14 



Attendance by Gates Students 
Through November 30 s 1982 



Attendance - 
Rate N (%) 



Grade 


Four 


94-100% 
84-93% 
1 ess than 
LTA* 


83% 


2,744 

1,036 
608 
28 


62.1 
23,5 
13.8 
0,6 


Grade 


Seven 


94-100% 
84-93% 
less than 
LTA* 


83% 


4,223 
2,463 
2,894 
142 


43.4 

25.4 
29.8 
1.4 



Source; Office of Student Information Services, 



*Long-tert7i absence. 
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VII. MIDYEAR OUTCOMES: JANUARY, 1983 TEST RESULTS 

EVALUATION QUESTIONS 

Data reflecting the impact of the 1982-83 full -year program will not be 

available before the beginning of the 1983-84 school year. Our purpose in 

analyzing mid-year results is to shed some light on the progress of Gates 

students* Looking at the January, 1983 test results, w^ asked ^ 

What proportion of Gates students were promoted in January as 
a result of meeting midyear promotional criteria? 

What proportion of Gates students were able to attain the less 
stringent end-of-year promotional criteria in January? 

What gains did Gates students make In reading and mathematics 
between April s 1982 and January, 1983? 

How do these results compare with last year's results? 

What were the observed gains made by subgroups of the Gates 
population and how did they compare to last year's gains? 

ATTAINMENT OF PROMOTIONAL CRITERIA 
Midyear Promotional Standards 

The January, 1983 administrations of the CAT, the N* Y.C.M.T. , and 
the LAB were meant to provide the highest achieving Gates students with 
an opportunity for promotion to the fifth or eighth grade at the midpoint 
of the school year. However, the desire to reward outstanding achieve- 
ment was tampered by the realization that students promoted midyear would 
encounter problems in their new grades, Evaluation of the 1981-82 Gates 
program indicated that students promoted In January, 1980, experienced 
great difficulty In attaining fifth- or eighth-grade promotional criteria 
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In April. 1982. As a result. In 1982-33 the criteria for midyear 
promotion were higher than they had been in the first year of the prograi 
The scores necessary for promotion in January, 1983 are displayed 
Table 15. 



_ trn 

in 



TABLE 15 

JANUARY, 1983 PROMOTIONAL CRITERIA 



Test Grade 4 Grade 7 



Mathematics - N.Y.C.M.T. (grade equivalent) 2 7 6 S 

Reading - CAT (grade equivalent) a s 7 * 9 

Reading - LAB (raw score) 15* 2 6 



For LEP students who have been In an English-language school svstem 
for more than two but less than four years. system 

January Test Results 

In January, as in August, students were held to either the reading 
criteria (reading-only holdovers) or the mathematics criteria (mathematics, 
only holdovers), or both (reading-mathematics holdovers), depending 
upon their performance on earlier tests. Eleven percent of the Gates 
students were able to meet midyear promotional criteria. An additional 
17.2 percent attained the less stringent end-of-year criteria, but were 
not promoted. 



The data are presented by grade and eligibility category in Table 
IS. Overall, seventh-grade students were more successful than fourth- 
grade students in attaining the midyear promotional criteria. On the 
other hand, fourth-grade students were more successful than seventh- 
grade students In attaining the end-of-year promotional criteria. In 
both grades, students who were eligible In both reading and mathematics 
had a great deal of difficulty in meeting the joint criteria. Only 
seven percent of the fourth-grade and ten percent of the seventh-grade 
reading-mathanatlcs holdovers attained even the end-of-year promotional 
criteria in both subjects in January. 

These results were can pa red to outcomes of the January, 1982 tests 
to get a sense of the program's relative success in 1982-83, After 
discounting the effect of mathematics criteria from the 1983 results, 
we found that outcomes in the two years were similar, In our midyear 
assessment of the 1981-82 Promotional Gates Program, we reported that 
32,6 percent of eligible fourth graders and 29,8 percent of eligible 
seventh graders were able to meet the end-of-year promotion criteria 
by January, 1982. In January, 1983, 31.2 percent of fourth graders and 
29 percent of seventh graders who were held over for reading were able 
to meet these end-of-year promotional criteria. The slight differences 
may reflect lower mean pretest scores in April, 1982. 
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TABLE 16 



Attainment of Promotional Criteria By Gates Students 

January, 1983 



Basis of Eligibll i ty 





Readi ng- 
Only 


Mathematics 
Only 


Readi ng- 
Mathtfatlcs 


Total 


■ 


Percent 
of those 
^n el igible 




Percent 
eligible 


n 


Pt rcerrc 
or &nose 
el Igible 


Percent 
of those 
n ui i a 1 hi p 


Grade Four 














Decenber Eligibles 


3,446 


i re 

133 




528 




6,129 


Number Tested In January 


3,447 63,3% 


56 


36, IS 


180 a 


34,1% 


3,683 . 60.1% 


Met January Criteria 


343 6,3 


15 


9.6 


2 b 


0,3 


360 5.9 


Attained End-of-Year 

Pronotional Criteria 0 


1,793 32.9 


47 


30,3 


37 


7,0 


1,877 30,6 


Grade Seven 














DtCOTber Eligibles 


3,317 


4,784 




4,976 




13,077 


Number Tested in January 


2,126 64,1 


3,014 


63.0 


2,823 d 


56,7 


7,963 60,9 


Met January Criteria 


517 15.6 


1,093 


22,8 


108 b 


2,2 


1,718 13.1 


Attained End-of-Year 

Promotional Criteria 0 


1,230 37,1 


1,780 


37.2 


498 


10,0 


3,508 26,8 



includes only those students who were tested in both mathematics and reading, 

b Includes only those students who met the criteria on both tests, In the fourth grade 
four students met the criterion in reading but not mathematies s and 30 students met the 
criterion in mathanatics but not reading. In the seventh grade, 297 students met the 
criterion in reading but not mathematics, and 392 met the criterion in mathematics 
but not reading, 

c 

Includes students who attained the January promotional criteria, 

*The percentage of seventh graders promoted midyear was greater than the 
percentage of fourth graders, 

°0verall s a greater percentage of fourth graders than seventh graders 
attained the end-of -year criteria, 
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STUDENT ACHIEVEMENT, APRIL. 1982 TO JANUARY. 1983 
Reading Achievement: An Overview 

The April, 1982 to January, 1983 gains in reading achievement of 
Gates students who were held over on the basis of reading scores are 
presented in Table 17,* Fourth- grade Gates students made adjusted 
gains of two months (11 scale score units) and seventh-grade Gates 
students made adjusted gains of five months (14 scale score units). 
The April, 1981 to January, 1982 adjusted gains of Gates students in 
reading achievement were two months in the fourth grade and four months 
in the seventh grade, indicating a slight increase in the impact of 
the Gates program on seventh graders' reading achievement in this 
second year of program Implementation, 

Reading Achie vement by Subgroups of the Gates Population 

Limited English Proficie nt (LEP) Students . LEP students who had 
been in an English-language program for more than four years were sub- 
ject to promotional criteria on the CAT.** The observed reading gains 
of these students from April, 1982 to January, 1983 were less than the 
observed gains of the total population,*** (See Table 18.) Fourth- 



*Appendix 0 presents observed gains In reading achievement bv 
canmunity school district, " 

**The gains of students who were subject to promotional criteria 
on the LAB are not reported here because there were too few students 
to yi el d meaningful results, 

***The scores of subgroups of the population cannot be adjusted for 
regression to the mean, so we have compared observed gains in both groups 
The same procedure was followed in looking at data concerning resource 
room students, 
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TABLE 17 



Reading Achievement by Gates Students 
April. 1982 tc January, 1983 



A P r11 « 19 82 January, 1983 



Di f ferenci 



rMrt3 w a Observed mean Adjusted mean b Grade Scale Grade Scale 

Grade N scale score (S.D. ) scale score equivalent score (S,D. ) equivalent score 



Four 3,506 370.3 (23,5) 386.7 3.4 398.1 (30.0) 3.6 11.4 

Seven 4,999 447.2 (28.7) 464.7 5.4 479.0 (37.2) 5.9 14,3 



This analysis Includes all students who were held over on the basis of reading scores below the 
promotional criteria and had both April, 1982 and January, 1983 CAT scores. 

An adjustment was made to account for regression to the meari. 
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TABLE 18 



Reading Achievment of LEP Students in the Gates Program 
April , 1982 to January, 1983 



April , 1982 January, 1983 



Di f fereno 



Grade 



Observed mean Grade Observed mean 

^ N a sco'4 ,3.0, S&t (S.D., 3& 



Four 



275 366,6 (23.0) 2.8 383,6 (31,8) 3.3 

Seven 253 441.1 (30,4) 4.6 467./ (34.3) 5.5 



17,0 
26,6 



^^™^! S 1983 C, jAr s c a Ii e L score^ entS °" *** » h ° ™ ^ W ■ 1982 

b Thise are observed gains, which are higher than real gains. 

Q LEP students made similar smaller gains than the total Gates 
-opulation. 
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grade LEP students made observed gains of 17 scat: e-seore units, com- 
pared with observed gains of 27.6 scale-store ynets for all fourth- 
grade Gates students; seventh-grade LEP Wis students made observed 
gains of 26,6 scale-score units, canpa red with Observed gains of 31,8 
scale score units for all seventh-grade Sites stu dents.* These data 
are consistent with our prior findings concerning Gates-eligible LEP 
students, and Indicate a need for scrutiijof services .being provided 
for than. 

Resource Room Students. The gains In reading achievement by Gates 
students who were also participating in tfieresour— ce rocm program are 
displayed in Table 19. These students made gains that were slightly 
higher than those of the general popul at 1m, just as they did last 
year. 

Mathematics Achievement: An Overview 

The April, 1982 to January, 1983 gains of Gater-s students in 
mathanatics which were impressive, are praiinted i n Table 20.** Fourth- 
grade Gates students made adjusted gains Hmthen— atlcs achievement 
of four months (26 scale score units) andiwenth-sgrade Gates students 
made adjusted gains of eight months (21 scale scor-e units). The average 
January grade-equivalent score of fourth graders was above the end-of- 



'Scale score units are used to allow rnenlngful conparison with 
the total population. 

** Appendix E presents the observed gains 1n mat- hematics achievement 
broken down by district, 
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TABLE 19 



Reading Achievement of Resource Room Students In the Gates Program 
April, 1982 to J snuary, 1983 



A Pr". 1982 January, 1983 



01 ff trance 



Observed mean Grade Observed mean Grade 

* tttl ( s,, X;< SS5 (s.o., 3?:« 



Four 41k 370.0 (22.3) 2.9 400.6 (30.3) 3.7 30.6 

Seven 388 448.3 ( 28.0 ) 4.8 485.1 (40.6 ) 6.1 36.8 



These are observed gains, which are higher t han real gains, 

°The gains of resourci room students were slightly higher than 
tnose of the general population. 
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TABLE 20 



Mathematics Achievement by Gates Students 
April, 1982 to January, 1983 



April, 1382 January, 1983 



i 



D1 f f erenei 



Observed Adjusted* 3 Observed 

r^H w * mein " ale ,- * mean scale Grade mean scale Grade Scale 

Grade score (S.D.) score equivalent score (S.D.) equivalent score 



F0Ur 208 244 * 8 (10-2) 252.6 2.6 279.0 (29.8) 3,0 26,4 

Seven 5,401 337,5 (20,1) 345.5 4,8 367.2 (31.9) 5.6 21.7 



This analysis Includes all students held over on the basis of (Mathematics scores below 
the promotional criteria and who have both April, 1982 and January, 1983 N*Y,C.M,T. scores, 

5 An adjustment was made to account for regression to the mean. (See Appendix D.) 

°Students in both grades made significant gains in achievement. 

°The average fourth-grade score was above the end-of-year promotional 
criteria. 

e The average seventh-grade score was only one month below the end-of-year 
criteria, J 
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year promotional criterion, and the average January grade^eq talent 
score of seventh graders was only one month below the crlteMM, 

Mathematics Achievement by Subgroups of the Sates Pop ulation 

Limited English Profici ent (LEP) Students . All LEP studfflts wft a 
had been In an English-language school Systran for more than tWyearrs 
were subject to promotional criteria on the N.Y.CM.T. Thgi r observed 
gains, presented in Table 21, were only slightly lower than tta of 
the entire Gates population, In the seventh grade, LEP stud%jits mads 
an average observed gain of 26.4 scale score units, compared with 
the average observed gain of 29.7 scale score units for the entire 
Gates group. Too few fourth-grade LEP students were subject -to the 
mathematics standard to allow a reliable cmparison. 

Resource Room Students. The gains in mathanatics achi eveimt by 
resource room students in the Gates program are presented in table 22:, 
The average observed gain in mathanatics achievement by seventh-grade 
resource room students was 36.4 scale-score units, somewhat hfjker th- an 
the observed gain of the entire seventh-grade Gates population. Here 
again, there were too few fourth graders to allow an analysis. 



-52- 



6;, 



TABLE 21 

Mathematics Achievement of LEP Students In the Gates Program 
April, 1982 to January, 1983 



April, 1982 January, 1983 Difference 

Observed Observed 
a mean scale Grade mean scale Grade Scale 

Grade N score (S.D. ) equivalent score (S S D S ) equivalent score 

Seven 224 331.1 (21.6) 4.3 357,5 (32.0) 5.2 26,4 

a This analysis includes all seventh-grade LEP students in the Gates program who had an April 
1982 and January, 1983 N.Y.C.M.T. scale scores. 

& These are observed gains, which are higher than real gains, 

e The average observed mathematics gains of seventh-grade LEP students 
were only slightly slower than those of the Gates population as a whole. 
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TABLE 22 



Mathematics Achievement, on the N.Y.CM.T. 
by Resource Room Students in the Gates Program 
April, 1982 to January, 1983 



April. 1982 January, 1983 Difference 



Observed Observed 
a mean scale , 4 Grade mean scale Grade Scale. - 

Grade N 3Core (S.D.) equivalent score (S,D.) equivalent score 5 



Seven 356 337.4 (19,1) 4,5 373,8 (32.5) 5.9 36.4 



'This analysis includes all seventh-grade resource room students in the Gates program who had 
both an April, 1982 ;nd January, 1983 N.Y.CM.T, scale scores. program wno naa 

These are observed gains, which are higher than real gains, 

"The average observed mathematics gains by seventh-grade resource room 
students were higher than those of the Gates population as a whole. 
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VII. CONCLUSIONS 

ORGANIZATION OF THE PROGRAM 

In 1982-83 the Promotional Gate s Program was far more conplex than 
it had been In its first year and presented formidable organizational 
problems. The introduction of a mathematics standard created three 
types of Gates students at each grade level. Nonetheless, the adminis- 
tration of the program was more efficient In 1982-83 than it had been 
the previous year. For example, appeals procedures were formalized in 
1982-83, and identification of Gates students and monitoring of class 
placantnt proceeded far more smoothly. 

Most students received appropriate Gates services, Data provided 
on the November 30, 1982 roster indicate that, overall, 87 percent of 
the Gates students for whom eligibility and class placenent information 
were available were assigned to appropriate classes. The placement of 
fourth-grade mathematics-only holdovers was inconsistent because many 
schools had too few students in this category to warrant the establish- 
ment of a Gates class. 

STAFF TRAINING 

Supervisors and teachers commented that staff training for the 
summer program was somewhat rushed. Teachers were particularly 
dissatisfied with the limited opportunities to study program materials 
and to practice suggested teaching techniques. Nonetheless, reactions 
to summer training were relatively favorable. In addition, the majority 
of participants In the August, 1982 training for the full-year Gates 
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program gave favorable ratings to each aspect of training under comider- 
eration. The November staff-development workshops received especially 
high ratings. Over 90 percent of participants found these workshops 
useful and relevant. The staff training component of the Gates program 
has becme increasingly successful over time and is highly appreciated 
by teachers and supervisors, 

INSTRUCTION 

The evaluation team was general ly impressed with smmr school 
instruction. The team praised teachers' interpersonal skills, the clarity 
of objectives, and the appropriateness of lesson content, However, 
lessons often lacked closure and follow-up and recamnendid mate rial s were 
frequently in short supply, Teachers often provided curricula other than 
those suggested for the program. Further improvements in this area may 
be necessary* 

Instruction in the full -year Gates program will be examined in the 
1982-83 end-of-year report, 

ATTENDANCE 

Seventh-grade attendance levels were poor In the summer and the 
fall of 1982, as they had been the previous year. The attendance problai) 
which surfaced in the program's first year renains serious, Attendance 
data for individual districts suggest that some solutions may reside 
in district practices and that It might be useful to Identify and shan 
exemplary practices that promote attendance. 



AC HIEVEMENT 

Overall achievement results for 1982-83 are not directly conparable 
to those of 1981-82 because of the mathematics criteria were not enforced 
until the program's second year of operation* However, the reading out- 
cones at the end of summer school and In January, 1983 were equivalent 
to or slightly better than last year 1 ! results. 

August, 1982 Results 

One-quarter of all students eligible for the Gates program In June, 
1982, became eligible for promotion by attaining the promotional criteria 
on the August, 1982 test(s), However, as might be expected, very few 
of the readi ng -mathematics holdovers were able to meet both criteria and 
qualify for promotion. 

Analysis of students' gains over the summer indicate that seventh 
graders made real gains in reading achievement, and students In both 
grades Improved their mathematics skills. The gains of fourth graders 
who wene elglble in reading were not larger than we would expect as a 
result of regression, It appears that the summer mathematics program 
had more direct impact on students than the communication arts program, 

Midyear Results 

The January test administration was meant to provide the highest 
achieving Gates students with an opportunity for promotion at the mid- 
point of the year, The midyear criteria for reading were set at even 
higher levels In 1982-83 than In 1981-82 In order to ensure that 
students promoted midyear would have continued success. The addition 
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of a mathematics standard also presented many students with more diffi- 
cult criteria for advancement. Nevertheless, the eligibility rate for 
promotion in January. 1983. was equivalent to that of January, 1982. 
In January, 1983, as in January, 1982, seventh-grade students were more 
successful in meeting the midyear reading criterion for their grade 
than were fourth-grade students. 

The percentage of Gates students meeting the end-of-year reading 
criteria in January, 1983 may be directly compared to the percentage 
who did so in January, 1982. In both grades, there was little difference 
fran one year to the next. Average reading gains in each of the two 
years were also similar. 

As in 1981-82, gains in reading achievement by Gates students who 
were also participating in the resource room program were higher than 
those by the general Gates population, and gains by limited English 
proficient students were lower. These data indicate that the services 
being provided to Gates students of limited English proficiency should 
be given careful attention. 

The percentage of students In each grade able to meet the end-of-year 
mathanatics criteria by January, 1983 was similar to that of students 
meeting the reading requirement. Students In both grades made appreci- 
able gains in mathematics achievement from April, < , 'vary, 1933. 
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.Detailed Pupil Accounting 
April through September, 1982 
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TABLE A-l 



Student Eligibility for the 
Prcmotional Gates Program after April , 1982 Testing 



Grade 

Four Seven Total 3 

(*) " (%) n (%) 



Exempt from Gates' 3 6,725 (10,1) 8,929 (12,3) 15,654 (11,2) 

No decision 0 1,421 (2.1) 4,150 (5.7) 5,571 (4.0) 

Scores below one or 
both test criteria 

(not exempt) 8,984 (13.5) 19,124 (26,3) 28,108 (21.6) 
Scores at or above 

both test criteria 49.594 (74.3) 40,438 (55.7) 90,032 (63.2) 



Total April , d 1982 

test group 66,724 (100.0) 72,641 (100.0) 139,365 (100.0) 



a 



l° r J n addi ^™^ 35 students were not available on the November 30 
isaz data tape used for tnese analyses. 

b In the fourth grade, 2,870 students were exempt on the basis of limited 
English proficiency (LEP), 3,855 were special education students; in the 
seventh grade, 3,202 were LEP students and 5,727 were classified as 
special education students. 

c No-dec1s1on students are either missing one test score (and have a passing 
score on the other test) or are missing scores on both the reading and 
mathematics tests. 

d These totals include all first-time fourth- and seventh-grade students 
tested in April, 1982. Students who had been held over in 1981-82 Gates 
classes (Gates Extension-eligible students) are not included. 



TABLE A-2 



Categories of Student Eligibility for the 
ProfflQtl qnal Gates "Program 
as of June, 1982 



Grade Four 



Reading Hq 
Reading only Math only 5 Math Total decision 



Students subject to 
promotional criteria 
after Aeri 1 s 1982 

t^ts 8,103 189 692 8,984 1,421 

Discharged - 278 -13 - 27 - 316 - 175 

Appeals/ 

exceptions - 762 7 = 6 - 775 - 12 

Category shifts 
as a result 

of exceptions - 6 * § ^9 =7 +7 



Grade Seven 



June. 1982 

ellgibles 7 P QS3 177 650 7,886 1,240 



Students subject to 
promotional criteria 
after Apri 1 , 1982 

te *tS 5.668 6,335 7.121 19,124 4,150 

Discharged - r 194 ^ 227 - 250 - 571 - 529 

Appeals/ 

exceptions - 813 - 358 - 83 -1,254 - 36 

Category * 22 + 77 116 ,17 * 17 

shifts as a 
■ result of 

exceptions- 



June, 1982 

e11 9ibles 4 9 §83 5,127 6,672 17,182 3,602 



NOTI* Students classified as reading-only are those with a CAT score below 
the criterion and either a mathematics score above the criterion or a missing 
mathematics score* Math-only students have a mathematics score below the ' 
criterion and either a reading score above the criterion or a missing reading 
score* Reading=and^math students have reading and mathematics scores below 
criterion* No-dec1s1on students are either missing one test score (and have 
a score above criterion on the other test) or art missing scores on both the 
reading and mathematics tests* 

i A student's eligibility category changed even if he or she was given an 
exception for only one test. 



FAILI A- 3 



Criteria At 


tainment by Gates-;." Mq 
Summer, 1982 


ble Students* 










Bas 3 


. f.f eligibility 






Reading- 
only 


Math- 
only 


Readi ng- 
Math 


No 

deei sion 








Grade Four 


— 


June, 1982 eligible? 


7,059 


177 


650 


i • fe'rU 


Number tested in August 


4,402 


75 


209 3 


10i b 


Met promotional criteria 


-1,947 


-58 


-33 


-68 


Category shifts^ 


*1S3 


+33 


-141 


-55 


September, 1982 eligible^ 


5,275 


152 


476 


1,117 








Grade Seven 




June, 1982 eligibles 


4,683 


5,827 


6.672 


3,602 


Number tested in August 


3,165 


3,819 


3,582 a 


376 b 


Met promotional criteria 


-1,961 


-2,143 


-592 


-196 


Category shifts d 


-537 


*1,016 


-1,370 


-183 


September, 1932 eligibles® 


3,253 


4,700 


4,710 


3,223 



These are students who were tested in both reading and mathematics, 

inese are students who were tested in reading or mathematics or both (if 
they needed it)* 

C A small number of students not included in these figures met one criterion 
but were not promoted because they needed a second test, 

^Category shifts arose primarily from: reading-mathematics holdovers who 
met the criterion on only one summer test, and ho-decision students who scored 
below criteria on one or both tests, 

e These totals do not Include the results of fall, 1982 continuous makeup testing. 
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TABLE A-4 



Criteria Attainment by Gates Students 
Who Were Eligible for Fall Makeup Testing 



Basis of Gates Eligibility 



Readl ng 
only 



Math 
only 



Readi ng 
fi Math 



Grade Four 



No 

deci slon 



September 1982 
Gates eliglbles 


5,275 


152 


476 


1,117 


Met criteria and 
wtrs promoted^ 






B — 


-62 


Category shifts* 3 


+127 


+2 


+44 


-173 


Gates students 1982-83 


5 ? 4Q2 


154 


520 


882 








Grade Seven 




Septmber, 1982 
Gates ellgibles 


3,259 


4,700 


4,710 


3,223 


Met criteria and 
were promoted 3 








-85 


Category shifts 


4-36 


+61 


+209 


-306 


Gates students 1982-83 


3,295 


4,761 


4,919 


2,832 



Students were eligible for the September makeup testing if they were miss inn 
either an April or an August, 1982 score on one or the other test! By 9 
th^il.?- K 0n ° ° f !u e h ! )1dovors were eligible for promotion on the basis of 

J£5 nnf S S ? tHey 1*5 8lready SCOred be1ow Pranotlonal criteria^ one 

test. Only no-decision students could be promoted, 

5 o^ e I° r K !u if 5 S .! r0Se frm no decision students who scored below criteria on 
one or both of the tests that they were taking for the first time. ' 
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APPENDIX b 

Summer School Participation 
by District 
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TABLE B-l 

Summer School Participation By Districts: Reading Classes 



Grace Four 



Grade Seven 







nut'i LJ tL- J 


P e n t 




Number 




Number of 


OttE Muizu 


a tt ended 


nUfTlDer or 


attend* 


01 s t pi ct 


0 1 1 n1 H 1 


15+ days 


15+ days 


e n gi o i es 


15* daj 




June 1982 






yuni, l^oi 


1 


168 


74 


{ 44, n H 
it*, y ; 




64 


2 


127 


la 






/ 3 


3 


171 


so 


f 4£ R\ 


494 


id J 


4 


215 


73 


^4**. UJ 




85 


5 


154 


86 


fee a \ 


3Q9 


127 


6 


3S2 


211 




374 


189 


7 


266 


135 




HUj 


171 


a 


254 


1 ^1 

A v I 




35 / 


326 


9 


492 


203 


(41,3} 


660 


49 4 


10 


683 


281 


(41-1) 


799 


307 


11 


165 


117 


(70-9) 


3S6 


173 


12 


266 


104 


(39.1) 


227 


68 


13 


278 


173 


(62,2) 


395 


201 


14 


28S 


134 


(47.0) 


456 


166 


15 


321 


199 


(62,0) 


392 


168 


16 


177 


101 


(57,1) 


224 


90 


I? 


474 


246 


(51.9) 


752 


272 


18 


141 


96 


(68,1) 


268 


148 


19 


487 


243 


(49.9) 


622 


301 


20 


172 


7S 


(43,6) 


401 


175 


21 


196 


93 


(47.4) 


311 


129 


22 


136 


75 


(55,1) - 


183 


104 


23 


205 


74 


(36.1) 


311 


ISO 


24 


191 


86 


(45, G) 


295 


109 


2S 


76 


30 


(39.5) 


109 


57 


26 


13 


9 


(69,2) 


66 


42 


27 


391 


162 


(41-4) 


531 


257 


28 


120 


79 


(65,8) 


211 


74 


29 


154 


36 


(55.8) 


351 


110 


30 




75 


(50.7) 


212 


ao 


31 


102 


56 


(54,9) 


314 


199 


32 


298 


161 


(54.0) 


369 


156 


33 


0 






6 


3 



Citywide 7,708 



3,826 



(49.6) 



1U3S5 



5,038 



Percent 
attended 
IS* days 



(24,7) 
(52.5) 

(48. a) 

(37,3) 
(43. S) 
(50,5) 

(39,5) 
(38.4) 
(47.3) 
(30.0) 
(50,9) 
(35.6) 
(42.9) 
(40,2) 
(36.2) 
(56.2) 
(48.4) 
(43.6) 
(41.5) 
(56,8) 
(48,2) 
(36,9) 
(52,3) 
(63.6) 
(48.4) 
(35, lj 
(54.15 
(37,7) 
(63.4) 
(42,3) 
(50.0) 

(44.4) 



|J0TE, These data are from students who scored below promotional criteria 
on the April, 1982 CAT, Summer attendance data wire not available from the 
few LAi-eligible students who took the summer LAB, Excluded arei students 
eligible for Gates on the basis of a below-cr1 teri on mathematics score onl-i 
and no decision students who had no spring, 19§2 reading score. In addition, 
some students attended fewer than lS days, These students, and any others 
for whom attendance data were not available, are considered Fonpartici pants 
in the summer school program. As a result, this may be a conservative 
estimate of summer school participation. 

i 0ne fourth-grade student who did not attend summer school 1s missing 
Because his or her district was not specified. 
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TABLE 8^2 

Summer School Participation by Districts: Mathematics Classes 



Grade Four Grade Seven 







Number 


Percent 




Number 


Percent 




Number of 


attended 


attended 


Number of 


attended 


attended 


st r1 ct 


el 1 gl bl es 


15+ days 


15* days 


el iglbles 


IS* days 


11+ days 




June, 1982 






June, 1982 


i 


28 


4 


14,3 


194 


100 


34,0 


4 


4 

4 


□ 




146 


59 


47.3 


-3 
J 


20 


5 


25.0 


268 


126 


47,0 


A 






15.6 


338 


133 


39,3 




4i 


q 


28,6 


313 


112 


3S.8 


s 


31 


3 


9,7 


469 


222 


47,3 


7 

f 


ii 
ji 


1 1 


35. 5 


395 


139 


35,2 


a 


25 


13 


52,0 


' 545 


303 


55,6 


9 


59 


S 


8,5 


799 


293 


36,7 


10 


72 


14 


19.4 


902 




40. l 


n 


12 


4 


33^3 


421 


181 


43,0 


12 


19 


0 




265 


71 


25. S 


13 


18 


2 


li.i 


419 


210 


45.8 


14 


19 


3 


15.8 


408 


148 


36,3 


15 


23 


9 


39,1 


454 


143 


31,5 


16 


25 


9 


36.0 


215 


89 


41.4 


17 


61 


20 


32.8 


800 


319 


39,9 


IS 


24 


11 


is. a 


358 


194 


S4,2 


19 


55 


11 


27,3 


125 


211 


40.2 


20 


18 


0 


0,0 


407 


173 


42.5 


21 


19 


1 


5,3 


302 


110 


36.4 


22 


16 


6 


37.5 


173 


83 


48.0 


23 


27 


12 


44,4 


391 


169 


43,2 


24 


17 


7 


41,2 


318 


128 


40,3 


25 


9 


0 


0,0 


103 


so 


48,5 


26 


0 


0 




81 


44 


54,3 


27 


S7 


16 


21,1 


568 


271 


47,7 


28 


9 


7 


77,8 


268 


127 


47.4 


29 


ia 


9 


io.o 


400 


197 


49.3 


30 


17 


s 


29,4 


288 


122 


42,4 


31 


3 


1 


33,3 


4in 


244 


59,5 


32 


38 


■ 13 


34,2 


388 


1S8 


40.7 


33 


0 






28 


IS 


S3, 6 


;ywi de 


327 


219 


(26.5) 


12,499 


5,316 


(42,5) 



jLQJH* These data are from those students who scored below promotional 
criteria on the April, 1982 N.Y.CM.T, It excludes: students eligible for 
the Gates program on the basis of a beiow^criterion reading score only; and 
no^declsion students who had no spring, 1982 mathematics score. In addition, 
some students attended fewer than IS daysi these students, and any others 
far whom attendance data were not available, are considered nonpartici pants 
1n the summer school program. As a result, this may be a conservative 
estimate of summer school participation, 
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7: 



Differences In Scores of Students 
Tested In August and Those Not Retested 
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August, 1982: The Tested Group 



The summer tests were voluntary, and comparison of the mean April CAT 
* c ° res t °[ students who opted for the August test with those of students who 
did not take the test revealed that a somewhat higher-than-average scoring 
group of students chose to take the August test. In the fourth grade April 
CAT scale scores for those not tested In August averaged 368.1- those tested 
on both occasions had a higher average April score of 375,1 scale score 
units. In seventh grade, the values were 446.0 and 454,2, respectively 
Looking at the N.Y.C.M.T. scores, we found that in grade four fl" V NY C H T 
scale scores for those not tested In August averaged 244.8; those tested on 



Participants and Nonparticipants 

April scores of participants and nonparticipants were very similar The 
average April CAT score of (retested) fourth-grade participants was 375 4 
scale-score units; the average retested nonpartieipant scored 373.7. Each 
ILrTf ^ L V 3 ;! 9^de equivalent. In the seventh grade the average 
score for both retested groups was 454.2, a 5.0 grade equivalent. In 
mathematics the fourth-grade summer school participants who took the 
August test averaged 247.2 scale-score units on the N, Y,G?M,T°, w^iTe the 
mean for retested nonparticipants was 245.8, " Each i s comparable to a 2 5 
grade equivalent. In the seventh grade, participants averaged 345 2 
fn a l e ; S 7° re ™ lts J. nonparticipants averaged 343.1. Each is comparable 
to a 4,7 grade-equivalent on the N.Y.C.M.T. We analyzed covariance (ANC0VA1 
to make partial adjustments for the slight differences in the April 1982 
scores of the two groups. 
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APPENDIX 0 

Statistical Adjustment of Pretest Scor 
to Account for Regression to the Mean 
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STATISTICAL ADJUSTMENT OF PRETEST SCORES 
TO ACCOUNT FOR REGRESSION TO THE MEAN 

The equation used to adjust pretest scores to account for the 

S r Maan° a n n nh C \ 1S ^ f ™" A '°* H * Roberts, "Regression Toward 
the Mean and the Regression Effect Bias" in New Directions fo r Testing 

f§-§§Sf% Number 8 * 198 °. CSan Francisco, Jossey-Bass j , pages l g-SZ. 

Xcs - Xs + _o| 

S (1 - 0 xx ) (Tg - Xs) 

This formula was used with the appropriate CAT or N, Y C M T value, tn 
correct April, 1982 pretest means, where: n.y.l.m.t, values to 



CAT, Form C N.Y.C.M.T.. Form B 
irade $ Grade T Grade 4 Grade 7 



Xcs - corrected pretest (scale score) mean 
of program participants 



Xs - pretest (scale score) mean of program 

participants ** ** t1t ^ 

Xg = city wide (scale score) mean on 

pre-test 446i7 $24.5 3S7.4 408 _ 6 

0 - standard deviation of pretest scale 

scores citywide , 64,6 75. 8 49.0 66.0 

s * standard deviation of pretest scale 

scores citywide , 52 ,i 59i6 4S>4 55 _ ? 

0 • coefficient of reliability 86 .86 .94 ,g 2 



♦These values are computed on the following pages. 

**These values appear on the following pages. Values from the Aoril 
to August and April to January periods differ since the 4 ™ period 
excludes the April scores of students who met the criteria in Augus?. 
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Adjustment' of April 1982 CAT for Students' Gai ns 
from April , To August, 198"! ~ — ~ ~ 



Grade Four (N =» 4,549, Ts --- 375,1) 



"X~gs = 375.1 + ffi4,6)S , 

filfT) 2 n-06) (446.7 - 375. 1) 
Xcs ■ 375.1 + 15.4 

"Xcs - 390.5 



Grade Seven (N » 6,862, Xs = 454.2) 



Xc. 454.e-* W (1 ,_ 85) (524 . 5 . 454 2) 

Xcs = 454.2 * 15.9 
Xcs = 470.1 



ustment of A pril, 1982 CAT for Students ' Gains 
from April, laaa to January, liff — ' " 



Grade Four (N = 3,506, Xs =370.3) 



Xcs - 370.3 * (64.6)? 

(52TT) (l -- 86 ) C 446 - 7 " 370.3) 
Xcs * 370.3 + 16.47 

Tcs = 386.7 



Grade Seven (N - 4,999, Xs - 447.2) 



Tcs = 447.2 * (75.8)1 , 

WW f 1 - 86 ) (5^4.5 - 447.2) 
Xcs = 447.2 + 17.53 

Ics = 464.7 
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ERIC 



Adjustment o f April 1982 N.Y.C.M.T. for Studen ts' Gains 
from Apn I , to Augus t, 1981 ' — — ~ 



Grade Four 



(N = 277, Is - 246.8) 

Tcs - 246.8 + (49.0)2 

(437?) d-' 94 ) ( 3E 7.4 - 246.8) 

Xcs = 246.8 + 7.9 

Tcs = 254,7 



Grade Seven 



(N -•• 7,037, Xs • 344.6) 



Xcs = 344,6 



2 

+ (flTT) 2 ( 1 -- 9 2) (408.6 - 344.6) 



Xcs =,344,6 + 7.2 
Xcs = 351.8 



Adj ustment of April ; 1982 N.Y. CM. T. for Students' Gains 
from April, imz to January. 1983 

Grade Four (N = 208, Xs = 244.8) 



Xcs 


= 244.8 


+ (49.0)1 
(4f77r 


(1-.94) 


(357.4 


- 244.8) 


Xcs 


• 244.8 


+ , 7.8 








Xcs 


= 25',. 6 










(N ■ 


« 5,401, 


Xs •-- 337. E 


i) 






Xcs 


- 337.5 


+ (66.0)1 
(1177) 2 


(1-.92) 


(408.6 


- 337.5) 


Xcs 


" 337,5 


+ 7.2 








Xcs 


•- 345.5 
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appendix e 



Student Achievement from April, 1982 to January, 1923 

by District 
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ERLC 



TABLE E-l 



Reading Achievement by Fourth-Grade 
Gates Students 
April, 1932 to January, 1933 



April , 1982 



January, 1983 



□i f ference 



Di strict 



Mean scale 
score 



(5.D.) G.E. 



Mean scale Scale 
score (S.D.) G.E. score 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
IS 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 



99 
49 
87 
91 
65 
178 
156 
114 
249 
364 
72 
121 
127 
130 
122 
97 
246 
63 
211 
48 
83 
53 
107 
73 
21 
3 

124 

46 

64 

51 

35 
156 



367,1 

370,2 

369,9 

365,9 

371.7 

368.6 

371.9 

374.3 

370,0 

366.5 

369.6 

367.6 

374.5 

369.9 

368.5 

373.4 

368.2 

374.9 

369.4 

367,3 

378.5 

374.7 

373,3 

377.5 

370,7 

370.3 

367.8 

369,8 

375.3 

371,8 

370,8 

371.4 



26,0 
21.5 
21.6 
22.4 



22 
21 
21 
19 
21 
25, 
25.8 
24.9 
21.8 
24.8 
31.4 
19.6 
25.1 
23.9 
25.8 
26.4 
17.6 
17.9 
20.4 
17.2 
30,8 
23,5 
27,4 
23.1 
19,5 
22.8 
20.6 
18,2 



2.8 

2.9 

2.9 

2.8 

3.0 

2.9 

3,0 

3.1 

2,9 

2.8 

2.9 

2.9 

3,1 



2 

2 

3 

2 

3 

2, 

2.8 

3.2 
3,1 
3,3 
3.2 
3.0 
2.9 
2,9 
2.9 
3.1 
3.0 
3.0 
3.0 



386.0 
409.7 
393.1 
392.3 
409.6 
393.8 
396.2 
394,8 
393.7 
393,0 
401.8 
393.2 
400.3 
389.4 
406, 
394, 
400, 
412. 
400, 
400. 
406.7 
403.4 
396.1 
406.9 
407.2 
407,0 
396.2 
404.1 
404.6 
410.8 
410.5 
400.2 



.0 
,3 
.6 
.0 
.4 
.9 



33,7 

27.1 

34.0 

35,1 

30.0 

35.2 

34.0 

31.2 

27.5 

26.5 

25.5 

27.4 

26.2 

30,3 

29.8 

24.2 

28.0 

33.8 

29.0 

30.0 

28.0 

28.5 

28.0 

25.5 

31,5 

31.2 

27.4 

27.0 

25.8 

33,9 

29.5 

30.0 



3.4 
3.9 
3.5 
3.5 
3.9 
3.5 
3.6 
3.6 



3 
3 
3 
3 
- 3 
3.4 
3.8 
3.5 
3.7 
3.9 
3.7 
3,7 
3.8 
3.7 
3.6 
3,8 
3.8 
3.8 
3.6 
3.8 
3.8 
3.9 
3.9 
3.7 



18.9 
39.5 
23.2 
25. 4 
37.9 



25 
24 
20 
23 
26, 
32.2 
25.6 
25.8 
19.5 
37.5 
20.9 
32.4 
37.1 
31.0 
33.6 
28.2 
28.7 
22.8 
,29.4 
36.5 
36.7 
28.4 
34.3 
29.3 
39.0 
39.7 
28,8 
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TABLE E-2 



Reading Achievement by 
Seventh-Grade Gates Students 
April, 1982 to January, 1983 



April , 1982 



Di strict 



1 

2 

3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 ■, 
22 
23 
24 
25 
26 
27 
23 
29 
30 
31 
32 



135 
61 
111 
92 
144 
172 
201 
245 
296 
436 
162 
76 
167 
252 
178 
96 
334 
108 
266 
168 
131 
71 
89 
122 
23 
28 
206 
84 
131 
76 
124 
212 



Mean scale 
score 



(S.D.) 



447,9 

439,8 

441,0 

449,6 

446.7 

446.3 

442,7 

447.1 

445,1 

444.5 

445,0 

450,7 

451.6 

445.7 

446,4 

438.7 

450.4 

447.7 

448,6 

450.2 

452.2 

451,6 

446.7 

449.0 

437.4 

452.0 

444.7 

449.2 

488,8 

446,2 

458,0 

448.2 



28,7 

34,5 

35.3 

26,2 

27.8 

26,7 

31,2 

28,7 

27.9 

27,8 

32.1 

21,9 

26,5 

25.8 

32,2 

31.7 

28,5 

31.5 

27.8 

27,1 

26,1 

30,0 

30,3 

28,8 

24,6 

26,4 

31,2 

29,4 

28,0 

30,6 

20.5 

26,7 



G.E. 



4,8 
4.6 



4 

4 

4 

4, 

4. 

4, 

4, 

4. 

4. 

4, 

5. 

4.8 

4.8 

4.6 

4.9 

4.8 

4.9 

4.9 

5,0 

5,0 

4,8 

4.9 

4.5 

5.0 

4.8 

4.9 

4.9 

4,8 

5,2 

4,8 



January, 1983 



Mean scale 

score (S.D, ) 



471,9 
477,8 
486,1 
477.8 
479.1 
478,8 
483.6 
477,5 
472.4 
478,0 
477.0 
474.1 
487. "> 
473.3 
480.3 
464.8 
478,6 
475.1 
471, 
484, 
488. 
491 
484,3 
480,6 
484.0 
488.8 
488,3 
469.0 
495,2 
466,6 
492,1 
472,3 



.1 

.9 
, 1 
.7 



33,2 
39.1 
34,8 
38.9 



38 
30 
40 
31 
36, 
36, 4 
35.5 
36.0 
40.8 
34.5 
32.9 
45.0- 
38.3 
36.8 
36.3 
36,5 
39.7 
35.9 
38,2 
37,5 
33,8 
29.6 
42,7 
35.8 
37,2 
32.9 
31,5 
36.9 



G.E, 



5.7 
5,9 
6.2 



5, 
5, 
5, 
6. 
5. 
5. 



5,9 
5,9 



5 
6 
5, 
6, 
5, 
5, 
5, 
5. 
6, 
6. 
6. 
6. 
6, 



.7 

,2 
,7 
.0 
4 
9 
8 
6 
1 
3 
4 
1 
0 



6.1 
6,3 



01 f ferenc 



Seal e 
score 



24,0 
38.0 
45.1 
28,2 
32.4 
32.5 
40,9 
30.4 
27.3 
33.5 
32,0 
23,4 



35 
28 
33 
26, 
28, 
27, 
22, 
34,7 
35,9 
40.1 
37.6 
31,6 
46,6 
36.8 
43,6 
19,8 
46,4 
20,4 
34.1 
24,1 
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ERIC 



TABLE E-3 



Math Achievement by 
Seventh-Grade Gates Students 
April, 1982 to January, 1983 



A P ril . 1982 January, 1983 



Di f feren< 



n . . . rcean scale v^l* 

District N score (S.D.) G.E. score (S.D.) G.E, score 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 



140 

60 
111 
120 
137 
191 
172 
227 
347 
449 
181 
110 
210 
201 
217 
77 
346 
128 
, 245 
* 164 
1 137 

I 68 

*173 

143 
29 
29 

246 

119 

139 

102 

174 

201 



339,4 

338,8 

331.2 

336,9 

338.6 

337.3 

337.8 

335.6 

334,8 

336.4 

338,7 

341.5 

338.0 

336.1 

338.5 

334.5 

336.2 

338.7 

339.5 

339.8 

340.8 

3<.0,8 

337,1 

335.9 

343.1 

339.8 

337.1 

336.0 

337.9 

338.0 

341,1 

338.4 



19,7 
20.7 
21,1 
21.6 
21,0 
20,1 
19,8 
20,2 
20,9 
20,5 
19,9 



18 

19 

19 

20 

21 

20. 

19, 

19. 

20. 

18, 

17, 

19. 1 
22.0 

18.0 
18.2 
20.8 
19.8 
19.1 
19.6 
18,8 
19.0 



,0 

.9 
4 
2 
0 
9 
1 
4 
0 
6 
7 



4.6 

4.S 
4.3 
4.5 
4,6 
4,5 
4.5 



4 

4 
4. 
4, 
4, 
4, 
4,5 
4,6 
4,5 
4.5 
4,6 
4.6 
4,6 
4,6 
4,6 
4.5 
4.5 



4. 
4, 
4, 
4, 
4. 
4. 
4. 
4. 



360,4 
373.3 
364.6 
362,5 
372.3 
372,2 
360.5 
362.7 
365.1 
367.6 
365,5 
364.8 
363,6 
359.2 
368. 
350. 
360. 
377. 
363, 
374. 
375. 



377 
364 
369 
373 
386,8 
366.6 
367,3 
381.1 
370,5 
386.0 
362,3 



29,3 
36.9 
33.1 
30.3 
31,9 
35,2 
26,7 
29,7 
34.8 
34,6 
27,3 
33.4 



29 
28 
31 
27 
31 
30 
27.0 
33.3 



32 
32 
30 
33 
28. 
25, 
29,8 
28.9 
36.3 
30.2 
32,6 
28.3 



5.3 

5,8 

5.5 

5.4 

5,8 

5.8 

5,3 

5.4 

5.5 

5.6 

5.5 

5.5 

5.5 

5.3 



5 
4 
5 
6 
5, 
5, 
6,0 
6,0 
5.5 
5.7 
5.9 
6,5 
5,6 
5.6 
6.2 
5.8 
6.4 
5,4 



21 

34 

33 

25 

33, 

34, 

22, 
27,1 
30,3 
31,2 
26,8 
23.3 
25.6 
23.1 
30,1 
15.5 
24,4 
38.3 
23.8 
34,4 

r: * 

J5, 1 

36.4 

27.4 

33.5 

30,5 

47,0 

29,5 

31,3 

43,2 

32.5 

44,9 

23,9 
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